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PREFACE 


It  has  always  been  the  objective  of  the  United  States  Government  to  acquire  needed 
weapons  systems  on  time  and  within  previously  established  cost  estimates.  This  ob¬ 
jective  however,  has  not  always  been  achieved  as  unanticipated  cost  growths  have  been 
experienced.  In  recognition  of  this  problem,  the  Army  initiated  a  series  of  management 
reviews  with  senior  industry  executives  to  examine  the  troublesome  area  and  seek  ideas 
to  improve  the  cost  management  and  cost  control  process.  Prominent  among  these 
reveiws  were  the  Secretary  of  the  Army's  Cost  Discipline  Advisory  Committee;  the 
Chicago  Cost  Discipline  Conference;  and  the  Atlanta  Executive  Seminars  with  Industry 
and  DARCOM.  A  key  element  emerging  from  these  reviews  is  the  need  for  establishing 
sound  and  realistic  cost  estimates  from  the  outset  of  any  programs. 

This  Seminar  brought  together  Defense  and  Industry  managers  who  are  involved  with  the 
development  of  cost  estimates  and  who  have  the  responsibility  for  cost  decision  making 
and  the  development  of  cost  estimates.  They  are  at  a  high  enough  level  in  their  re¬ 
spective  organizations  to  understand  the  cost  estimating  process  and  the  causes  of  cost 
estimating  problems.  The  objective  was  to  develop  a  better  understanding  of  the  cost 
estimating  problem,  seek  new  ideas,  and  develop  improved  methods  for  management  of 
the  cost  estimating  process.  Throughout  the  life  cycle  of  any  program,  there  will  be  a 
succession  of  various  cost  estimates  from  the  initial  estimates  made  when  the  program 
is  first  conceived  to  the  final  accounting  of  the  costs  to  produce  and  operate  the  wea¬ 
pon  system.  Because  industry  has  a  major  role  in  developing  the  initial  cost  estimates 
used  in  the  budgeting  and  program  process,  it  must  share  prime  responsibility  with 
Defense  for  producing  weapon  systems  on  time  and  within  original  cost  estimates. 

Discussion  within  this  Seminar  enabled  Military  &  Industry  Managers  to  understand  how 
each  other  develop  costs.  The  Seminar  also  examined  the  various  problems  in  improved 
methods  for  developing  and  presenting  cost  estimates  with  a  final  objective  of  estab¬ 
lishing  a  better  understanding  of  this  process  as  a  vital  step  toward  better  cost  man¬ 
agement  and  control. 


SUMMARY  REPORT 


A  Seminar  on  the  Cost  Estimating  Process 
February  7-8,  1984,  Arlington,  Virginia 

Introduction 


An  alternate  title  for  this  seminar  might  be  "Controlling  Defense  Procurement 
Costs  -  A  Cost  Estimating  Perspective".  The  thrust  of  the  program  was  to 
build  on  prior  initiatives  (like  the  Chicago  Cost  Discipline  Conference  and 
Atlanta  IX)  to  control  these  costs;  two  presentations  focused  on  these  earlier 
efforts  so  as  to  set  the  stage  for  the  following  panels. 

The  panel  recommendations  speak  for  themselves.  Rather  than  highlighting 
them,  I  want  to  focus  on  three  areas  which  were  often  addressed  during  the 
seminar : 

o  Problems  in  timely  definition  of  program  requirements, 
o  The  need  for  contingencies. 

o  The  major  challenges  of  controlling  ownership  or  operating  costs. 
Program  Definition 

Program  instability,  properly,  has  been  given  a  large  share  of  the  blame  for 
cost  growth.  But  the  discussions  highlighted  difficulties  in  developing 
timely,  crisp  definition  of  mission  requirements  and  system  specifications  as 
contributors  to  higher  cost  directly,  and  indirectly  through  increases  in 
program  instability  downstream.  It  appears  to  industry  that  the  process  of 
defining  requirements  and  specifications  takes  too  long  (several  years  is  not 
uncomon).  The  process  appears  inefficient  as  well  in  requiring  detailed 
estimates  (a  4000  page  BCE  was  cited)  before  the  program  definition  is 
established.  Inability  to  get  program  requirements  clarified  when  estimating 
their  cost  in  response  to  an  RPQ  was  cited  as  a  cause  of  delays  as  well  as 
inaccurate  estimates. 

The  following  questions  are  suggested  for  further  study: 

o  Does  the  program  definition  process  systematically  consider  the  views  of 
the  field  commands  and  the  DA  staff  as  well  as  TRADOC?  Can  industry  be 
brought  into  the  process  earlier? 

o  Are  estimating  techniques  too  standardized  for  use  at  the  requirements 
definition  stage?  It  appeared  that  the  only  choices  are  rather  complex, 
parametric  methods  or  detailed,  bottcms-up  BCE's.  Is  there  a  need  for 
quick -turnaround  estimates  that  can  be  used  while  iterating  system 
definitions?  Are  there  effective  means  for  trading  off  mission 
effectiveness  vs.  cost  during  this  period? 

Contingencies 

The  use  of  contingency  provisions  is  widely  disputed  and,  even  when  included 
in  funding  reouests,  they  are  often  deleted  during  the  approval  process. 

Still,  there  was  wide  agreement  on  the  selective  need  for  contingencies  and 
their  use  has  often  prevented  overruns  downstream.  Three  ideas  were  discussed 
which  might  help  get  contingencies  better  accepted  and  effectively  used  in 
program  estimates: 


o  Determine  the  basis  for  the  basic  estimate  as  precisely  as  possible;  did 
it  include  contingencies  and/or  assume  future  (undefined)  efficiency 
improvements? 

o  Define  the  purpose(s)  of  the  contingency  provisions  as  specifically  as 
possible;  e.g.,  expected  requirements  changes,  quantity  increases, 
specific  design  risks. 

o  "Selling"  a  contingency  may  be  easier  if  cost  performance  improvement  over 
past  experience  is  also  included  in  the  estimate.  The  question  of 
estimates  based  on  historical  costs  vs.  standards  was  discussed  in  this 
regard.  The  Air  Force  is  moving  toward  the  use  of  standards  in  cost 
estimates  as  a  means  of  forcing  cost  reduction  and  stripping  out  the 
effect  of  past  inefficiencies.  (Incidentally,  the  proper  use  of  standards 
as  a  control  tool  can  improve  actual  cost  performance  even  in  job  shop 
environments) .  In  any  event,  it  is  dangerous  to  merely  assume  that  future 
performance  improvements  will  offset  the  need  for  contingencies. 

Operating  Costs 

Operating  expenses  typically  account  for  well  over  half  of  total  program 
costs.  There  was  general  agreement  on  the  need  to  more  carefully  consider 
these  costs  in  determining  system  specifications,  to  establish  dependable 
means  of  measuring  them,  and  to  establish  incentives  to  control  them.  One 
basic  issue  that  needs  more  study  is  sourcing.  Just  as  the  military  customer 
expects  a  contractor  to  justify  his  make /buy  decisions,  a  review  of  depot- 
level  maintenance  scurcing  may  be  highly  productive.  Ccrmercial  customers  are 
increasingly  finding  it  cost-effective  to  contract  for  maintenance.  Perhaps 
policies  which  restrict  contract  maintenance  need  to  be  re-evaluated,  if 
potential  savings  are  sufficient. 


As  a  final  thought,  the  seminar  highlighted  three  key  factors  which  have  been 
demonstrably  effective  in  preventing  cost  growth:  timely,  crisp  program 
definition,  estimates  which  include  proper,  carefully-defined  contingencies 
and  effective  incentives  for  cost  control  and  cost  reduction.  Although  none 
of  these  factors  are  easy  to  achieve,  continued  efforts  toward  doing  so  are 
clearly  worthwhile. 


L.  L.  Allison 
Chairman 


DEFENSE  KEYNOTER  PRESENTATION 


LTG  Robert  Moore 

Deputy  Commanding  General  for  Research,  Development  &  Acquisition 

HQ  DARCOM 

Since  the  Chicago  Conference  in  July  1982  and  the  Atlanta  IX  Conference  in 
early  March  1983,  I  belive  it  would  be  safe  to  say  that  we  in  DARCOM  have 
made  some  progress  towards  improving  our  costing  systems  and  in  bringing  our 
costs  under  control. 

As  I  reread  portions  of  ADPA'S  report  of  the  Chicago  Conference  Proceedings, 

I  renoted  one  of  the  Bottom  Line  Summary  conclusions  which  indicated  that 
Program  Instability  —  not  Cost  Growth  —  was  the  primary  contributor  to  most 
of  our  cost  discipline  problems.  The  report  further  observed  that  up  to 
seventy-five  percent  of  cost  increases  were  related  to  program  turbulence 
(requirements  changes,  program  delays,  and  so  on).  I  naturally  agree  100 
percent  with  that  observation  since  I've  been  preaching  about  it  at  every 
available  opportunity.  Program  instability  is  definitely  our  worst  enemy 
and  we  must  and  will  find  ways  and  means  to  bring  our  programs  under  control. 

We've  got  to  curb  our  insatiable  appetite  that  keeps  adding  to  an  already 
full  plate.  Among  the  150  selected  comments,  15  basic  conclusions,  and  31 
specific  recommendations  reflected  in  parts  V,  VI,  and  VII  of  the  Chicago 
Report,  one  Army  weakness  was  dealt  with  which  should  warrant  further  atten¬ 
tion  by  this  group  —  and  I'm  referring  to  the  abilities,  or  lack  thereof, 
of  our  acquisition  people  —  a  deficiency  that  we  are  pursuing  with  vigor 
as  part  of  our  Materiel  Acquisition  Management  Program.  We  will  train  and 
assign  people  throughout  their  careers  to  better  prepare  them  as  acquisition 
managers . 

Many  of  the  cost  discipline  issues  raised  at  the  '82  Chicago  Conference  were 
rehashed  last  March  by  the  cost  control  panel  in  Atlanta.  Following  Atlanta, 
selected  industry  and  Army  representatives  from  the  several  panels  convened 
follow-on  meetings  with  General  Keith,  the  Commander  of  DARCOM.  The  follow- 
on  meeting  for  the  cost  control  panel  resulted  in  narrowing  down  some  38 
suggestions  to  3  basic  recommendations. 

One,  that  we  improve  program  cost  estimating,  had  two  parts.  First  was  to 
make  source  selections  based  on  real  cost  differences  rather  than  bottom-line 
bids.  After  considerable  review  of  our  policy  and  practices,  we  concluded 
that  present  policy  guidance  is  adequate  for  the  source  selection  process. 
Based  on  my  personal  experience  at  MICOM  and  in  my  present  position,  I  can 
attest  that  the  lowest  bidder  is  not  awarded  the  contract  unless  all  technical 
considerations  and  other  necessary  prerequisites  are  met.  An  industry 
observation  in  the  Atlanta  IX  report  specified  that  "A  low  bid  is  almost 
invariably  considered  credible  by  the  government."  This  simply  isn't  the 
case,  particularly  for  our  larger  programs. 

The  second  part  of  this  recommendation  sanctions  the  establishment  of  a 
"program  definition  phase"  to  determine  firm  specifications  and  program 
costs.  Our  MSC's  wrestled  a  great  deal  with  this  one  and  came  up  with  the 
pros  and  cons  for  three  alternatives. 
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The  first  consists  of  a  2  to  6  month  post-award  phase  to  define  and  refine 
system  specifications  and  hardware  concepts.  That  alternative  has  potential 
legal  problems  that  could  be  incurred  with  losers  on  a  competitive  bid,  and 
because  of  the  uncertainty  it  would  inject  in  the  initial  cost  estimate. 

We  are  nonetheless  going  to  try  this  approach  with  the  Howitzer  Improvement 
Program  (HIP).  Alternative  2,  which  considered  a  separate  requirements 
definition  phase,  was  rejected  on  the  basis  that  it  would  cost  additional 
time  and  money.  We're  also  pursuing  a  third  alternative.  We  propose  to 
award  two  contracts  to  the  winner  of  the  full  scale  development  source 
selection.  The  first  contract  is  for  a  two-to-six  month  contract  definition 
phase,  and  it  is  executed  immediately.  The  second  contract  is  for  the  con¬ 
ventional  FSD  effort,  but  its  execution  is  contingent  upon  the  results  of 
the  contract  definition  phase.  The  Army  may  also  choose  to  negotiate  changes 
based  on  the  first  phase.  Although  this  approach  may  take  a  little  extra 
time,  we  feel  its  benefits,  namely  the  contractor's  refinement  of  the  scope 
of  work,  technical  approach  and  design-to-unit-production-cost  (DTCJPC)  goals, 
should  pay  ample  dividends  in  terms  of  program  stability,  and  avoidance  of 
technical  and  support  problems.  This  alternative,  I  believe,  is  within  the 
intent  of  the  recommendation.  We're  now  in  the  process  of  selecting  a  can¬ 
didate  system  to  use  as  a  trial  horse. 

Transition  of  our  systems  from  development  to  production  has  received  a 
tremendous  amount  of  emphasis  during  the  past  two  years  following  some  sad 
lessons  learned  during  the  previous  5  to  6  years.  We  have  taken  a  number 
of  positive  actions  to  get  our  production  engineering  house  in  order. 

Probably  the  most  important  is  a  change  to  DARCOM  Regulation  70-6,  Produci- 
bility  Engineering  Planning  (PEP),  which  really  provides  the  needed  tools 
to  do  the  job  right.  They  include  fencing  PEP  funds  in  the  R&D  appropriations; 
requiring  that  the  RFP  and  source  selection  process  assess  PEP  separately; 
making  PEP  a  separate  contract  line  and  requiring  contractor  accountability 
of  PEP  efforts;  and  requiring  successful  PEP  completion  (to  include  validation) 
as  a  basis  for  production  go-ahead. 

The  third  recommendation  was  based  on  the  Atlanta  cost  panel's  perception 
that  contractors  and  their  military  customers  are  not  sufficiently  motivated 
to  reduce  costs.  In  a  nutshell,  the  panel  is  saying  to  reward  those  who  put 
forth  the  effort  and  realize  cost  savings,  and  penalize  those  who  don't. 

Our  study  concluded  that  it  is  feasible  to  establish  program  cost  control 
standards  and  measure  an  individual's  performance  against  those  standards. 

Some  progress  has  been  made  towards  implementing  the  concept  in  both  military 
OER's  and  in  civilian  performance  appraisals.  Also,  a  person's  performance 
in  managing  cost-related  requirements  of  his  or  her  job  will  be  given  equal 
consideration  in  performance  appraisals  to  that  for  meeting  schedules  and 
for  performing  technical  tasks.  In  addition,  several  efforts  are  underway 
to  induce  contractor  cost  reduction  incentives,  including  reviewing  the 
feasibility  of  translating  0&S  cost  estimates  into  contractual  incentives 
(RAM,  Warranties,  etc.)  and  examining  the  relationship  between  operational 
intensity  and  0&S  cost  elements. 

We've  putting  more  attention  up  front  in  acquisition  planning  and  communication 
between  user,  developer  and  industry  to  positively  influence  the  outcomes 
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when  we  execute  the  production.  We  also  must  put  more  money  up  front,  like 
PEP,  to  reduce  the  burden  of  cost  in  production.  Cost  analysts  and  programmers 
must  allow  for  this.  A  small  investment  in  front-end  dollars  yields  a  much 
larger  payoff  later  in  production;  and  the  better  we  communicate  our  needs 
and  define  our  tradeoffs,  the  better  acceptability  our  product  ought  to  have. 

Now,  let  me  leave  a  challenge  on  the  table.  I  believe  our  goal  in  life  is 
to  be  able  to  document  and  justify  at  any  point  in  the  life  cycle  the  true 
value  of  what  a  system  should  cost.  Early  on,  we  must  estimate  through 
parametric  means  and  derive  cost  goals  like  DTUPC.  The  government  must, 
fortunately  or  unfortunately,  ask  for  the  money  for  production  at  least  three 
years  before  the  first  production  occurs.  So  at  best  these  first  estimates 
are  based  on  parametric  analysis  and  not  actual  prices.  So  we  must  allow  the 
DTUPC  to  change  as  the  design  changes;  make  certain  we  keep  our  conceptual 
estimates  and  baseline  cost  estimates  as  realistic  as  possible  and  not  done 
in  a  vacuum  from  what  the  contractor  believes.  Since  early  production  negoti¬ 
ations  cannot  be  based  on  actual  costs  -  in  my  view  we  must  have  our  pricers 
and  costers  work  to  an  independent  government  estimate,  based  on  our  most  current 
DTUPC  information  and  using  parametric  analyses  and  pricing  as  best  we  can. 
Industry  must  do  likewise.  Then,  when  we  have  sufficient  real  cost  data  from 
production,  we  do  a  full  scale  “should-cost  study."  This  estimate  should  be 
relatable  to  our  baseline  cost  estimate.  It  will  let  us  set  our  sights  on  what 
the  Army  and  industry  think  the  item  should  cost  off  the  production  line. 

A  true  “should-cost"  might  not  occur  until  about  the  third  production  contract. 

We  don't  need  to  do  a  full  should-cost  but  once.  They  are  too  expensive  and 
too  time  consuming!  We  then  re-adjust  our  cost  curves;  determine  the  recur¬ 
ring  and  non-recurring  prices,  and  negotiate  on  the  major  differences.  The 
recurring  costs  should  not  be  significantly  different  in  either  industry's 
or  the  government's  estimates  at  the  time,  or  in  any  future  production  year 
negotiation.  We  also  look  to  value  engineering  and  other  cost  reduction 
methods  to  reduce  the  impact  of  inflation  and  lower  the  cost  of  the  item  over 
time.  We  must  do  something  to  shorten  our  negotiations  and  increase  our  col¬ 
lective  faith  in  cost  estimates  and  proposals.  We  spend  too  much  time  and 
resources  in  our  negotiating  and  costing  areas  to  not  give  our  procedures 
(or  lack  thereof)  concentrated  attention. 


ADPA  SEMINAR  ON  THE  COST  ESTIMATING  PROCESS 

7-8  FEBRUARY  1984 
SESSION  II 

Management's  View  of  the  Problem 
Outline  for  Remarks  By 
R.  L.  Johnson 

Corporate  Vice  President  -  Group  Executive 
McDonnell  Douglas  Corporation 

INTRODUCTION 

Importance  of  solving  cost  growth  problem 

National  defense  posture  capability 
Specific  program  survival  and  endurance 
General  company  and  industry  reputation 

A  recognized  problem  -  many  years 

Many  attempts  to  solve  -  four  most  recent 

SecArmy  Cost  Discipline  Advisory  Coimittee 
ADPA  Panel  -  Overplan  Costs  of  Army  Programs 
Chicago  Cost  Discipline  Conference 
Atlanta  IV  ADPA/DARCOM  Conference 

Problem  -  more  fundamental  than  technique  or  discipline 

Mr.  Johnson  covered: 

Highlights  of  above  conferences  -  in  which  involved 
ADPA  Panel  and  Chicago 
Some  comments  on  personal  lessons  learned 
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II.  ADPA  PANEL  -  '81/' 82  (Study  at  VCSA  request) 

IMPORTANT  PROBLEM  AREAS/RELATED  SOLUTIONS 

1.  Inadequate  system  and  program  definition 

2.  Inadequate  Program  Funding 

3.  Government  Program  Manager  Continuity  Experience  and  Tenure 

4.  Erosion  of  Government  Program  Manager's  Authority 

5.  Insufficient  Contractor  Internal  Discipline 

6.  Inadequate  Attention  to  Production  Cost 

7.  Inadequate  Preparation  for  Development/Production  Transition 

8.  External  Forces 


RECOMMENDED  ACTIONS 

1.  Modify  FSED  source  selection  evaluation  critieria  so 
that  the  only  cost  considerations  are  factors  that  are 
different  for  each  proposer. 

2.  Initiate  FSED  with  a  definition  period  in  which  the 
Army  and  the  winning  contractor  thoroughly  define  the 
system  and  program,  together  with  instant  contract  costs  and 
budgetary  total  program  costs  including  expected  reserve 
requirements. 

3.  Take  actions  to  provide  incentives  for  and  direction  of 
a  material  program  manager  career  path. 

4.  Provide  for  program  oversight  techniques  to  ensure 
contractor  attention  to  important  areas  requiring 
internal  discipline. 

5.  Recognize  that  achieving  acceptable  production  unit 
costs  for  new  equipment  is  a  continuing  process  and 
establish  methods  for  guiding  the  process  and  using 
the  output  information. 

6.  Reconmend  to  DOD/Congress  that  FSED  validate  not  only 
the  product  design  but  also  the  production  process 

and  provide  funds  to  bridge  the  gap  between  development 
and  production. 
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ADPA/ARMY  CHICAGO  COST  DISCIPLINE  CONFERENCE  -  MID  '82 


BOTTOM  LINE  CONCLUSIONS 

1.  Basic  cause  of  cost  growth  is  Program  Instability 

2.  Program  Instability  Causes 

o  Technical  complexity  not  fully  understood 
o  Level  of  risk  and  resulting  potential  cost  problems  not 
fully  appreci ated 

o  Resolution  of  problems  associated  with  large  performance 
gains. 

3.  Highly  competitive  environment  in  DOD  and  industry  contributes 
to  problem 

4.  Inflation  is  a  second-order  effect. 

BOTTOM  LINE  RECOMMENDATIONS 

1.  Army  should  concentrate  its  efforts  on  Program  Instability 
Problem. 

a.  By  adequate  system  definition  by  combined  team  of  single 
developing  Contractor  and  Army  at  beginning  of  FSED. 

b.  Resist  performance  and  technological  improvements  after 
FSED  initiation. 

c.  Insist  on  good  Contractor  discipline. 

d.  Budget  and  track  production  cost  during  development  phase 

e.  Manage  program  and  all  problems  in  a  cooperative 
Contractor/Army  team  fashion. 

2.  Army  should  acquire  capability  to  better  assess  technical 
uncertainties  and  associated  cost  risk. 

3.  Army  should  (after  accomplishing  2.  above) 

a.  Balance  requirements  and  costs 

b.  Program  adequate  time  and  funds  to  accommodate  level 
of  technical  uncertainty. 

c.  Place  less  emphasis  on  cost  level  in  evaluating 
competitive  proposal  for  development  program. 

PERSONAL  LESSONS  LEARNED 

1.  Early  discussion  with  senior  service  officials 

Technical  and  funding  pressures 

2.  Generation  of  an  Army/Contractor  cooperative  approach  early 

3.  Faster  action  together  with  Army  when  problems  appear 

4.  The  basic  and  underlying  "cultural"  problems  leading  to 

the  under  estimation  of  program  costs  will  be  very  difficult 
to  solve. 


SUMMARY  REPORT 


Military  Cost  Estimating  Conference  - 
Status  and  Army's  Plan  to  Improve 


The  following  report  summarizes  my  presentation  to  the  American  Defense 
Preparedness  Association  (ADPA)  Cost  Estimating  Symposium  in  Pentagon  City, 
Virginia,  7-8  February  1984.  The  report  outlines  the  general  process,  actions 
on  going  to  improve  the  process,  and  remaining  problems  and  issues.  At  the 
request  of  the  chairman,  it  has  been  reduced  to  two  pages. 

PROCESS.  The  Army  cost  estimating  process  is  well  managed  and  improving.  It 
constitutes  a  family  of  estimates  which  develop  over  the  life  cycle  of  the 
weapons  system.  The  estimates  are  complimentary  and  interactive.  The  initial 
estimate  supports  a  cost  and  operational  effectiveness  analysis  w^ich  assesses 
the  benefits  and  costs  of  several  alternatives.  The  alternatives  may  describe 
ways  of  dealing  with  a  threat,  exploiting  new  technology,  or  a  combination  of 
the  two.  After  selection  of  the  most  cost-effective  alternative,  the  cost 
element  of  the  equation  is  translated  into  the  baseline  cost  estimate  (BCE). 
This  estimate  from  the  outset  lays  out  the  total  program  costs;  research, 
development,  test,  and  evaluation  (RDTE),  procurement  and  military 
construction  funds  needed  to  develop  and  procure  the  system;  and  military 
personnel,  procurement  and  operation  and  maintenance  funds  needed  to  field  and 
sustain  the  system.  The  "reasonableness"  of  the  BCE  is  cross-checked  by  an 
Independent  Cost  Estimate  (ICE)  prepared  by  an  impartial  team.  The  BCE  is 
translated  into  a  budget  using  the  most  likely  point  estimate  as  the  budget 
submission  to  DOD  and  the  Congress.  The  BCE  also  serves  as  a  benchmark  for 
contractual  actions  such  as  source  selection  boards  and  should  cost  teams. 

IMPROVEMENT.  The  following  improvements  are  being  made  or  have  been  made 
recently  in  the  process. 

a.  Annual  Update  of  the  BCE.  The  estimates  are  updated  annually  as  a 
minimum.  This  replaces  a  procedure  of  updating  a  major  developmental 
milestone  which  tends  to  occur  3-4  years  apart. 

b.  Restructure  of  the  BCE.  Baseline  estimates  have  been  restructured  to 
clearly  identify  the  funds  required  in  each  Congressional  appropriation,  i.e., 
RDTE,  Military  Construction  Army,  etc.  This  action  facilitates  a  crosswalk 
into  the  budget. 

c .  Restructure  and  Emphasis  on  the  Materiel  Systems  Requirements 
Specification  (MSRS).  The  MSRS  has  been  restructured  to  more  clearly  describe 
the  capabilities  and  characteristics  of  the  system.  The  MSRS,  which  precedes 
each  BCE,  outlines  exactly  what  is  to  be  costed. 

d.  Improved  Methodology  via  Contractual  Support.  Over  $3M  in  contracts 
have  been  let  in  FY  83  and  FY  84  to  improve  the  qualitv  of  data  bases  and 
bring  methodology  to  the  state  of  the  art.  Continued  expenditure  and  major 
resources  are  planned. 
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e.  Linkage  to  the  Budget.  A  special  subcommittee  of  the  Army  Staff 
Program  Budget  Advisory  Committee  (PBAC)  now  insures  that  all  system 
acquisition  decisions  are  translated  into  the  budget. 

f.  Linkage  to  the  Contracting  Process.  That  portion  of  the  BCE  which 
lays  out  data  of  value  prior  to  contract  negotiations  has  been  expended.  The 
BCE  now  clearly  identified  design  to  unit  production  cost  of  the  system,  unit 
cost  of  components,  and  estimates  of  labor  and  material  where  possible. 

g.  Standard  Inflation  Methodology.  The  Army  Staff  has  developed  a  method 
based  on  standard  industrial  codes  which  calculates  the  historical  inflation 
incurred  during  system  development.  This  is  an  important  calculation  to 
permit  comparison  with  inflation  indices  and  contract  inflation  clauses. 

4.  WEAKNESSES.  The  major  weaknesses  of  the  process  are: 

a.  Insufficient  Personnel.  Due  to  shortage  of  personnel,  we  are  unable 
to  provide  dedicated  cost  analyst  cells  for  many  high  dollar  project  managers. 
Although  these  managers  receive  support  from  their  local  cost  offices,  the 
size  and  criticality  of  the  projects  dictate  dedicated  support. 

b.  The  Inconsistencies  in  Estimating  Formats  and  Processes  Between  the 
Military  Departments.  Many  defense  suppliers  have  a  legitimate  complaint  that 
dealing  with  the  Army,  Navy  and  Air  Force  requires  three  different  types  of 
data  and  responses  in  three  different  formats.  The  suppliers  ask  if  they  can 
get  an  annual  calendar  of  requirements  and  avoid  crash  efforts.  The  move  by 
the  Army  to  a  new  cost  estimating  format  is  a  specific  example  of  this 
problem. 


c.  Difficulty  of  Defining  the  "User."  It  appears  to  industry  estimators 
that  many  people  within  the  Army  claim  to  speak  for  the  "user."  All  of  these 
user  representatives  have  the  authority  to  request  a  new  estimate. 

d.  Contractor  Support  Versus  Government  Maintenance.  There  is  no 
agreement  as  to  the  relative  cost  effectiveness  of  contractor  support  versus 
government  maintenance  during  the  fielding  and  sustaining  of  a  weapon  system. 
There  is  no  model  or  methodology  which  conclusively  lays  out  the  variables. 
Each  case  must  be  studied  on  its  own  merit,  but  the  estimating  process 
contains  variables  for  organic  maintenance  only.  Contractor  personnel  believe 
they  should  be  able  to  submit  the  estimates,  which  the  Array  would  believe,  for 
contractor  maintenance. 

SUMMARY.  Many  informal  contacts  were  made  with  industrial  cost  estimators. 
These  contacts  proved  very  benefical.  DARCOM  and  DA  must  complete  the 
Improvements  outlined  above  and  develop  strategies  to  deal  with  the 
weaknesses . 
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PANEL  MEMBERS 


Chairman  -  Peter  D'Angelo,  Assistant  Division  Controller, 
Missile  Systems  Division,  Raytheon  Company 

Members  -  Russell  Feury,  Chief  cost  Analysis  Division, 

US  Army  Tank  Automotive  Command 

-  Col  James  Welsh,  Project  Manager,  Mobile 
Protected  Gun,  US  Army  Tank  Automotive  Command 

-  Fred  Sheffey,  Director  of  Engineering 
Administration,  Missiles  &  Advanced  Program 
Division,  Vought  Corporation 

-  William  Benfer,  Manager  Contract  Services/ 
Government  Affairs,  Texas  Instruments 


PURPOSE  OF  PANEL 

Examine,  from  Industry  and  Army  points  of  view,  the  process 
and  problems  involved  in  improving  the  initial  program  budgeting 
and  planning  estimates,  and  discuss  actions  which  might  be  taken 
to  improve  the  accuracy  of  the  process. 

CONCLUSIONS: 

1)  Parametric  Modeling,  learning  curves,  and  other  data 
base  oriented  estimating  techniques  can  be  effective  cost 
estimating  tools.  One  of  the  most  significant  problems  in  the 
estimating  process  is  limited  program  definition  in  the  initial 
budgeting  and  planning  stages  of  a  program. 

2)  Program  Cost  drivers  as  well  as  system  cost  drivers 
must  be  identified  "early  on"  and  tracked  during  the  program 
initiation  and  demonstration/validation  phases  of  a  program. 
These  factors  are  significant  contributors  to  the  cost  growth 
problem. 

3)  In  many  cases,  there  is  limited  or  no  industry  parti¬ 
cipation  until  the  exploratory  R&D  phase  of  a  program.  Industry 
can  provide  the  Army  with  additional  tools  and  insight  in  the 
early  planning  stages  of  a  program. 


4)  Historically,  initial  estimates  have  been  optimistic 
in  that  they  tend  to  reflect  a  success  oriented  program  without 
adequate  consideration  for  program  risks  such  as  delays,  tech¬ 
nical  concerns/changes,  and  system  performance  risks.  However, 
the  thrust  of  the  Army  today  is  to  avoid  such  an  approach. 

For  example,  the  MPGS  PM  went  to  considerable  effort  to  reflect 
a  realistic  program  in  his  Baseline  Cost  Estimate  (BCE) . 
Furthermore,  the  Independent  Cost  Estimate  (ICE)  concept  has 
been  developed  to  test  the  reasonableness  of  the  PM ' s  BCE  and 
to  assure  realistic  program  cost.  The  ICE  concept  was  applied 
in  the  case  of  the  MPGS,  resulting  in  a  second  opinion  confirming 
such  reasonableness.  In  conjunction  with  this  initial  estimate 
a  draft  outline  of  test  and  evaluation,  ILS  and  acquisition 
strategy  plans  must  be  developed,  at  least  through  the  initial 
fielding  stage  of  the  proposed  program. 

RECOMMENDATIONS : 

1)  In  order  to  develop  a  sound  cost  estimate  "early  on", 
that  is  prior  to  DSARC  I,  a  Study  Plan  must  be  developed, 
reviewed,  and  approved.  This  plan  must  serve  as  a  "stake  in 
the  ground"  for  the  initial  estimate  and  must  clearly  identify 
all  of  the  principle  program  costing  assumptions  such  as  hardware 
definition,  program  schedules,  acquisition  strategy,  etc.  The 
technical  and  program  managers,  users,  and  cost  estimators  must 
be  involved  in  the  process.  Also,  there  needs  to  be  more  data 
base  development  as  the  basis  for  parametric  modeling  and  other 
cost  estimating  tools.  This  can  be  accomplished  with  Industry 
and  the  Army  working  together  in  the  design  of  computer  software 
foi  an  Automated  Cost  Data  Base  (ACDB)  and  investigating  and 
analysis  of  all  pertinent  documents  for  capturing  costs  for  input 
into  such  an  ACDB  in  accordance  with  the  requirements  of  the 
Army  Cost  Analysis  Program. 

2)  The  key  cost  drivers  must  be  identified  "early  on"  in 
this  process.  Program  cost  drivers,  such  as  development/produc¬ 
tion  schedules  and  acquisition  strategy,  as  well  as  system  cost 
drivers  such  as  performance  requirements,  new  technologies,  and 
expensive  system  and  system  integration  elements  must  be  high¬ 
lighted.  a  "tracking  system"  which  assesses  the  impact  of  changes 
to  the  initial  set  of  costing  assumptions  must  be  implemented. 
Estimates  must  be  updated  on  a  timely  basis  to  ensure  a  "closed 
loop"  system  whereby  the  decision  makers  are  fully  aware  of  the 
cost/benefit  impact  of  proposed  program  changes.  We  recommend 
that  the  present  Program  Management  Control  System  (PMCS)  also 

be  utilized  as  an  element  of  this  tracking  system  and  that 
evolution  of  cost  estimates  be  analyzed  and  reconciled  to  ensure 
that  a  "closed  loop"  system  in  place.  A  tracking  system  in  the 
conceptual  phase  of  a  program  can  also  provide  the  early-on 
production  unit  cost  visibility  so  necessary  during  this  process. 


3)  Industry  participation  on  a  study/ support  basis 
should  be  considered  in  the  initial  program  planning  stage. 

While  the  Army  has  a  broader  data  base  than  any  single 
contractor,  a  particular  contractor  may  have  more  "vertical" 
visibility  within  a  particular  product  line.  This  represents 
a  potentially  valuable  resource  that  could  be  tapped  when 
circumstances  dictate  that  this  course  of  action  be  pursued. 

In  the  early  stages  of  some  program  starts,  this 
can  be  accomplished  by  the  use  of  Management  Consultants 
working  with  Industry  to  assist  the  Army  in  the  development 
of  acquisition  plans  and  strategy.  "Program  Briefings"  to 
Industry,  similar  to  those  conducted  by  the  various  commodity 
commands  for  RFP ' s ,  should  also  be  considered  for  the  purpose 
of  soliciting  comments  from  Industry  regarding  improvements 
to  the  development  and  acquisition  strategy.  These  Program 
Briefings  should  be  conducted  prior  to  or  in  parallel  with 
development  of  RFP ' s  and  other  documentation  necessary  for 
the  initial  ASARC  decision  makers. 

4)  A  risk  assessment  must  be  performed  and  included  with 
all  estimates.  The  level  of  detail  will  vary  in  the  earliest 
estimates  commensurate  with  the  program  specificity,  however, 
program  and  system  cost  drivers  must  be  addressed  at  all 
stages.  Given  that  Program  stretchs/delays  will  occur  for 
example,  contingencies  must  be  included  in  the  initial  estimate 
for  this  purpose. 

Funding  for  these  contingencies  should  be  "fenced"  at 
higher  levels  within  the  Army  to  ensure  that  they  do  not 
become  self-fulfilling  prophecies  but  rather  enhance  the 
visibility  of  the  decision  makers  and  key  management  personnel. 

5)  Communications  with  key  DOD  personnel  and  Congressional 
personnel  must  be  improved  to  the  point  that  program  rationale, 
assumptions  and  risks  are  clearly  identified.  In  this  manner 
the  Program  Manager  will  be  better  armed  to  resist  changes  to 
the  program  and,  any  changes  that  occur  will  be  better  documented 
as  to  their  origin  and  impact. 


he 
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Summary  Report  on  the  Recommendations  from  Session  V 
and  Production 


Engineering  Develt, 


Panel  V,  which  was  made  up  of  Army,  Air  Force,  and  Industry  participants 
concentrated  its  efforts  on  the  estimating  process  during  engineering  develop¬ 
ment  and  production. 


Contractor  estimates,  per  se,  were  determined  by  the  Panel  to  generally  be 
of  high  quality  given  the  requirements  and  assumptions  on  which  the  estimates 
were  based;  and  they  were  considered  to  be  the  least  responsible  element  for 
contract  overruns. 


However,  the  need  for  improvements  in  the  estimating  process  itself  was 
recognized  as  a  real  issue.  Specific  areas  that  our  recommendations  for 
improvements  in  the  process  addressed  should  be  a  step  towards  better  cost 
management  and  control . 

One  of  the  key  items  that  tended  to  come  up  across  many  areas  we  evaluated 
as  in  need  of  improvement  was  the  ever  prevalent  issue  of  communication. 
Communications  between  the  Army  and  the  contractor,  between  contractor 
management  and  contractor  program  personnel,  between  government  estimators  and 
contractor  estimators,  between  government/contractor  design  engineers  and 
government/contractors  estimators,  the  list  goes  on  and  on.  Our  first 
recommendation  specifically  addressed  this  issue  and  it  is  an  integral  part  of 
several  of  the  other  recommendations. 


Another  item  which  seemed  to  be  prevalent  in  several  areas  discussed  was 
the  need  for  an  earlier  flow  of  estimating  data  from  contractors  to  the  govern¬ 
ment.  We  suggest  adding  a  data  requirement  to  AD  and/or  ED  phase  contracts  to 
require  contractors  to  provide  contractor  estimates  of  the  program  under 
development  (CCE's  -  ICE  *  s  -  Contractor  Cost  Estimates  -  Independent  Contractor 
Estimates).  This  would  bring  into  focus  two  issues  -  earlier  involvement  by 
the  contractors  estimating  discipline  and  normal  management  review  of  the 
estimating  process  as  well  as  providing  the  government  with  another  data  point 
for  determining  the  programs  expected  cost. 

The  Army’s  use  of  an  Operational  Baseline  Cost  Estimate  (OBCE)is  a 
recommendation  that  is  currently  in  process  of  being  implemented  within  the 
Army.  The  panel  members  felt  that  although  the  apparent  emphasis  on  the 
mechanization  did  not  necessarily  in  itself  improve  the  duality  of  the  numbers, 
it  does  however  provide  a  powerful  tool  for  the  program  management  office  to 
use  in  keeping  their  BCE  current  which  should  result  in  better  control  and 
management  of  the  program. 
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Should  cost  efforts  on  the  part  of  the  government  was  discussed  both  in 
views  of  the  Air  Force  and  by  the  Army  -  it  was  a  general  opinion  that  the 
feedback  of  data  upon  conclusion  of  the  should  cost  team's  review  was  either 
late  in  coming  or  initially  at  such  a  summary  level  that  there  was  not  an 
understanding  of  the  should  cost  team's  basis  from  which  a  contractor  could 
respond.  In  addition,  our  last  recommendation  is  one  that  I  believe  should  be 
addressed  before  it  grows  to  such  a  magnitude  of  paper  as  to  further  erode  the 
focus  on  the  quality  the  estimate  vs.  the  quantity  of  data  that  only  segregates 
and  categorizes,  etc.,  etc.,  that  result  in  volumes  of  paper  as  part  of  cost 
responses  to  RFP  requirements.  Whereas  more  emphasis  should  be  placed  on 
improving  the  definition  of  requirements,  the  basis  upon  which  the  estimate  is 
based  and  the  assumptions  made  in  the  preparation  of  the  estimate. 

Below  is  a  listing  of  our  recommendations. 

1.  Communications  -  Function  to  Function 

Establish  a  professional  estimating  interchange  forum  between  the  Army 
and  industry  with  a  charter  to  improve  on  the  tools  and  techniques. 

2.  Operational  Baseline  Cost  Estimate  (OBCE) 

Program  managers  should  implement  the  OBCE,  thereby  maintaining  a 
dynamic  baseline  cost  estimate. 

3.  Independent  Cost  Estimates 

Formalize  the  budgeting  process  by  soliciting  formal  industry 
independent  cost  estimates 

4.  Should  Cost  Estimates 

Require  prompt  detail  feedback  to  contractors  at  completion  of  the 
should  cost  review 

5.  Quality  vs.  Quantity  in  Terms  of  Cost  Volume  Required  Responses  to 
RFP's 

Reduce  the  amount  of  required  response  to  segregate  cost  data  that 
doesn't  contribute  to  its  quality. 


SESSION  VI  -  LIFE  CYCLE  COSTING 


Chairman:  Mark  H.  Burmeister  Director 

PRICE  Systems 
RCA  Corporation 


Panel  Members: 

BG  Ronald  K.  Andreson  Deputy  Commanding  General  for 

Research  and  Development 

U.S.  Army  Aviation  Systems  Command 

Edward  B.  Fritz  Assistant  Controller  for  Pricing 

Sikorsky  Aircraft  Division 
United  Technologies  Corporation 

Frank  A.  Shelden  Cost  Analysis  Manager 

Ordnance  Engineering  Division 
FMC  Corporation 

G.  Norman  Stanard  Chief,  Developmental  Cost  Analysis 

Directorate  for  Plans  and  Analysis 
U.S.  Army  Aviation  Systems  Command 

Introduction 

In  the  life  cycle  of  a  weapons  system,  by  far  the  most  expensive  phase 
is  the  fielding  and  sustainment  of  the  weapons  system.  Yet,  it  is  this 
phase  of  the  life  cycle  which  has  the  poorest  quality  historical  cost 
data  base  from  which  future  cost  estimates  may  be  generated.  The  panel 
focused  upon  the  need  to  identify  cost  drivers  early-on,  and  the  value 
of  conducting  early  cost  trade-off  studies  to  gain  relative  cost  indications 
if  not  accurate  cost  magnitude  projections.  A  special  presentation  on  the 
Black  Hawk  program  illustrated  the  dramatic  effect  of  reliability  on 
sustainment  costs,  which  further  emphasized  the  need  to  identify  the  cost 
drivers  prior  to  the  start  of  detailed  design. 

Discussion 

System  configuration  or  hardware  selection  along  with  the  maintenance  and 
support  concepts  established  for  the  system  will  determine  most  of  the 
ultimate  life  cycle  cost  of  that  system.  This  determination  is  made  so 
early  in  the  conceptual  stage  that: 

1)  Few,  if  any,  details  of  the  actual  hardware  are  known  which 
causes  the  problem  of  bottoms-up  estimating  to  be  difficult 
to  solve. 

2)  Any  cost  estimates  pertaining  to  fielding  and  sustainment 
can  be  little  more  than  educated  guesses. 


SESSION  VI  -  LIFE  CYCLE  COSTING 


In  view  of  the  foregoing,  greater  emphasis  should  be  placed  on  the  use  of 
parametric  modeling  techniques  to  assess  the  relative  costs  of  alternative 
configurations.  Even  though  total  costs  will  still  be  uncertain,  at  least 
the  most  cost  effective  alternatives  can  be  quickly  identified,  and  some 
degree  of  assurance  that  lower  costs  will  be  achieved  ultimately,  even  if 
total  costs  are  still  unknown. 

Using  models  for  cost  discriminating  purposes  can  be  done  in  the  absence 
of  any  substantial  historical  cost  data  bases.  However,  to  use  models  for 
cost  magnitude  purposes  with  a  high  degree  of  confidence,  better  cost  data 
bases  must  be  built.  Much  of  the  mechanism  for  collecting  standard  inputs 
for  parametric  models  is  already  in  place  (e.g.,  DD  2089),  but  the  use  of 
these  mechanisms  is  not  universally  observed. 


Conclusions 


Lack  of  current  and  significant  historical  cost  data  bases  for  sustainment 
costs  hampers  the  use  of  cost  magnitude  models  and  reduces  the  degree  of 
confidence  in  their  results.  Early-on  bottoms-up  estimating  is  inaccurate, 
and  historically,  has  been  more  harmful  than  beneficial.  Greater  emphasis 
should  be  placed  on  the  use  of  cost  discriminating  models  to  influence 
design  and  fielding  considerations. 


Recommendations 

1)  Expand  the  use  of  parametric  cost  models  early-on  to  influence  initial 
system  design,  production  and  fielding  decisions. 

2)  Establish  data  bases  for  ownership  cost  as  well  as  for  development  and 
production  costs,  but  recognize  that  technology  causes  obsolescence  in 
areas . 

3)  Develop  a  standard  measurement  modeling  policy  for  all  the  Armed  Services 
e.g.,  use  existing  forms  like  DD  2089  universally. 

4)  Put  more  emphasis  on  DTLC  cost  incentives  to  contractors.  Re-evaluate 
current  incentive  policies  which  sometimes  result  in  counter-DTLC 
incent ives . 

5)  In  addition  to  evaluating  project  related  logistics  concepts  for  cost 
effectiveness,  the  non-project  related  logistics  structure  may  have 
been  outdated  by  technology,  and  should  be  re-examined  in  that  light. 

6)  Publish  a  Program  Management  calendar  so  that  industry  knows  due  dates, 
and  will  have  the  time  to  plan  for  and  respond  with  better  estimates. 
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ROBERT  TOWNSEND 
AVCO 

V  P  FINANCE 
201  LOWELL  ST 

WILMINGTON  MA  018S7 


WILLIAM  WALLACE 
HQ  DA 

SENIOR  ENGR.  ENGR  TM 
DAMA-CSS,  RM  3D422,  PENTAGON 
WASHINGTON  DC  20310 


COL  JAMES  B  WELSH 

US  ARMY  TACOM 

PROGRAM  MANAGER 

ATTN.  DRCPM-PG 

WARREN  MI  48090 


GEORGE  J.  WOOD  ITCH 
US  GAO 

NATL  SECURITY  AND  INTERNATL 
AFFAIRS  DIVISION 
WASHINGTON  DC  20548 


D.  8  STR  INGHAM 
FORD  AEROSPACE 
DIR  ACCTG  P  O  BOX  43342 
300  RENAISSANCE  CENTER 
DETROIT  MI  48243 


F  B  WADE 

GOODYEAR  AEROSPACE 
ESTIMATOR  PROD  LINE 
P  O  BOX  85 

LITCHFIELD  PK  AZ  85340 


BG  CARLTON  P  WEIDENTHAL 
USA  TACOM 

DEP  COMMANDING  GENERAL 
WARREN  MI  48090 


ROBERT  WILSON 
COLT  FIREARMS 
P  0  BOX  1868 

HARTFORD  CT  06102 


BENJAMIN  ZYCHER 
JET  PROPULSION  LAB 
ECONOMIST 

4800  OAF  GROVE  DP  M/S  506-21* 
PASADENA  CA  *1109 


LrC  *  .-J  STR  tM  I C  t  K6  i  ' 
ADVANCED  TE-HNCLCj:  INC 
T=>23  JONES  BRANCH  DRIVE 
MCLEAN  VA  22102 


RQDERT  E  VERGE 
SCIENCE  APPLICATIONS  INC 
MGR  COST  EST 

3191  MAGUIRE  BLVD.  STE  ICO 
ORLANDO  FL  32S03 


ROBERT  0  WEIDENMUlLER 
HQ  DARCQM 

ATTN  DRCCP-E. CHF  COST  ANAL 
5001  EISENHOWER  AVE  PM  3S34 
ALEXANDRIA  VA  22333 


THOMAS  S.  WIED 
GENERAL  DYNAMICS/POMONA  DIV 
VP  CONTRACT  ?<  ESTIMATING 
P  0  BOX  2507  MZ  1-52 
POMONA  CA  91769 


WILLIAM  J  YUKNAVICH 
MARTIN  MARIETTA  AEROSPACE 
MGR  ESTIMATING  CENT  FINANCE 
PO  BOX  5837  MP  387 
ORLANDO  FL  32855 


DR.  KATSUAKI  TERA3AWA 
JET  PROPULSION  LAB 
SUPER  ECONO  ?<  POLICY  ANALYSIS 
4800  OAK  GROVE  DR  M/S  506-2.- 
PASADENA  CA  9110® 


LARRY  P  WAGGONER 
US  ARMY 

OPERATION  RES  ANALYST 
ABERDEEN  PROVING  GROUD 
ABERDEEN  MD  21005 


WALTER  WEISSE 
HAM I L TON  STANDARD  DIV/UTC 
MGR  OPERATIONS  ENG 
BRADLEY  RD  M/S  1-3-2 
WINDSOR  LOCKS  CT  0uG9* 


DR  RAYMOND  F  WOJCIESZAK 
GENERAL  ELECTRIC  CO 
MGR  MFG  TECH  ASSESSMENT 
1  NEUMANN  WAY 

CINCINNATI  OH  4521 5 


